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(54) CAMERA SIGNAL PROCESSOR AND METHOD THEREFOR AND MEDIUM FOR 
RECORDING CONTROL PROGRAM OF THE SAME DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To attain effective white 
balance adjustment. 

SOLUTION: A white balance controlling means 33 
calculates a correction coefficient for matching a 
white balance for each color component of RGB 
signals based on an inputted subject video through 
an integrating means 31. When the next scene is 
inputted, a gain controller 32 multiplies the 
corresponding RGB signals by this correction 
coefficient for generating adjusted RGB signals. Also, 
a luminance controlling means 36 compares the RGB 
constitution rate of the integrated result, based on the 
RGB signals of this scene with the RGB constitution 
rate of the adjusted RGB signals, and when a 

deviation between the color temperature of a video, based on the adjusted RGB signals, 
and the color temperature of the subject video is large, the luminance controlling means 36 
limits the gain level of the luminance signal in a luminance gain controller 35 according to 
the level of this deflection. 
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JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2 **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim l] It is the camera signal processor which carries out transform processing of the 
picturized color signal based on the hue of the photographic subject image into which it 
was inputted by predetermined time, every predetermined element color - a spectrum 
An integral means to integrate with the color signal for the above-mentioned 
predetermined time for every element color, and to output the integral result. The white 
balance control means which adjusts the white balance of the above-mentioned color signal 
based on the above-mentioned integral result, and outputs a correction color signal. The 
camera signal processor characterized by providing the intensity-level control means 
which compares the element color percentage of the above-mentioned integral result with 
the element color percentage of the above-mentioned correction color signal of each pixel, 
and controls the gain level of the luminance signal based on this correction color signal. 
[Claim 2] It is the camera signal processor characterized by what the gain level of the 
luminance signal based on this correction color signal is restricted for according to extent 
of this deflection when the deflection of the color temperature of the image on a camera 
signal processor according to claim 1 and based on the above-mentioned correction color 
signal in the above-mentioned intensity-level control means and the color temperature of 
the above-mentioned photographic subject image is large. 

[Claim 3] every predetermined element color ■ the above-mentioned predetermined time 
a spectrum - the camera signal-processing approach characterized by what the element 
color percentage of this integral result compares with the element color percentage of this 
correction color signal of each pixel, and the gain level of the luminance signal based on 
this correction color signal controls for when the white balance of this color signal adjusts 
based on this integral result and a correction color signal outputs, while integrate with the 
picturized color signal and outputting the integral result. 

[Claim 4] every predetermined element color •■ the aboye-mentioned predetermined time 
a spectrum, while integrating with the picturized color signal and outputting the integral 
result When the white balance of this color signal is adjusted based on this integral result 
and a correction color signal is outputted, The medium which recorded the control program 
of the camera signal processor characterized by what the element color percentage of this 
integral result is compared with the element color percentage of this correction color signal 
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of each pixel, and the gain level of the luminance signal based on this correction color 
signal is controlled for. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the medium which recorded the control 
program of a camera signal processor, the camera signal-processing approach, and a 
camera signal processor. 
[0002] 

[Description of the Prior Art] CCD2 which the conventional camera signal processor 1 
changes an input image into an electrical signal as shown in drawing 4 , and outputs a 
color signal, The RGB matrix 3 which changes this color signal into an RGB code, and the 
gain controller 4 which adjusts a white balance about this RGB code, and outputs an 
adjustment RGB code. An integral means 5 to output the integral result for every color 
component while integrating with this RGB code over predetermined time. It has the 
control means 6 which controls the white balance adjustment in the gain controller 4 based 
on each integral result, and the YC matrix 7 which changes an alignment ready RGB code 
into a luminance signal and a color-difference signal. 

[0003] If CCD2 changes into an electrical signal the image inputted through the lens and 
outputs a color signal by this configuration, the RGB matrix 3 will change this color signal 
into an RGB code. And if the integral means 5 integrates with this RGB code over 
predetermined time and outputs the integral result for every color component, in a control 
means 6, the multiplier in a gain controller will be computed based on each integral result. 
Then, the gain controller 4 multiplies the above-mentioned RGB code by this multiplier, 
adjusts a white balance, and outputs an adjustment RGB code. And the YC matrix 7 
changes and outputs this adjustment RGB code to a luminance signal and a 
color-difference signal. 

[0004] Therefore, in this camera signal processor 1, changed into the luminance signal and 
the color-difference signal the adjustment RGB code obtained by carrying out white 
balance adjustment of the RGB code based on an input image as it was, and it was 
outputted, and it was outputting by performing gain control according to the intensity level 
of this luminance signal. 
[0005] 

[Problem(s) to be Solved by the Invention] There were the following problems in the 
conventional camera signal processor mentioned above. That is, when an input image 
changed suddenly after the gain controller 4 adjusted the white balance, this change could 
not be followed but the feeling of resolving of the image which only the intensity level of a 
predetermined color component is reproduced highly, and corresponds was spoiled. 
Moreover, when gain control according to the intensity level of a gain controller 4 smell 
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lever was performed, required gain might not be acquired essentially. For this reason, 
white balance adjustment of the RGB code based on an input image was not able to be 
carried out effectively. 

[0006] This invention was made in view of the above-mentioned technical problem, and 
aims at offer of the medium which recorded the control program of the camera signal 
processor in which effective white balance adjustment is possible, the camera 
signal-processing approach, and a camera signal processor. 
[0007] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, invention 
concerning claim 1 It is the camera signal processor which carries out transform processing 
of the picturized color signal based on the hue of the photographic subject image into which 
it was inputted by predetermined time, every predetermined element color -- a spectrum " 
An integral means to integrate with the color signal for the above-mentioned 
predetermined time for every element color, and to output the integral result, The white 
balance control means which adjusts the white balance of the above-mentioned color signal 
based on the above-mentioned integral result, and outputs a correction color signal, It has 
considered as the configuration possessing the intensity-level control means which 
compares the element color percentage of the above-mentioned integral result with the 
element color percentage of the above-mentioned correction color signal of each pixel, and 
controls the gain level of the luminance signal based on this correction color signal. 
[0008] namely, an integral means - every predetermined element color - the 
above-mentioned predetermined time " a spectrum, while integrating with the picturized 
color signal and outputting the integral result When a white balance control means adjusts 
the white balance of this color signal based on this integral result and outputs a correction 
color signal, An intensity-level control means compares the element color percentage of 
this integral result with the element color percentage of this correction color signal of each 
pixel, and controls the gain level of the luminance signal based on this correction color 
signal. The case where integrate with each color component of RGB for every scene, and 
the integral result is outputted that the above-mentioned integral means should just be 
the configuration which can integrate with the color signal for the above-mentioned 
predetermined time for every element color, and can output the integral result etc. is 
included. 

[0009] The above-mentioned white balance control means adjusts the white balance of a 
color signal based on the above-mentioned integral result, and just outputs a correction 
color signal. Therefore, when the color signal corresponding to the input image under a 
white LGT with the low color temperature of the light source is reddish to the hue of an 
actual input image, R component is pressed down, and when the color signal corresponding 
to the input image in the outdoors where the color temperature of the hght source is high is 
bluish to the hue of an actual input image, the case where press down B component and a 
correction color signal is outputted etc. is included. 

[0010] The above-mentioned intensity-level control means compares the element color 
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percentage of the above-mentioned integral result with the element color percentage of the 
above-mentioned correction color signal of each pixel, and just restricts the gain level of the 
luminance signal based on this correction color signal. As an example of the configuration 
of this intensity-level control means, in the camera signal processor according to claim 1, 
invention concerning claim 2 is considered as the configuration which restricts the gain 
level of the luminance signal based on this correction color signal according to extent of 
this deflection, when the above-mentioned intensity-level control means has the large 
deflection of the color temperature of the image based on the above-mentioned correction 
color signal, and the color temperature of a photographic subject image. That is, an 
intensity-level control means measures the color temperature of the image based on the 
above-mentioned correction color signal, and the color temperature of the above-mentioned 
photographic subject image, and when deflection is large, according to extent of this 
deflection, the gain level of the luminance signal based on this correction color signal is 
restricted. 

[0011] The technique of performing camera signal processing, as mentioned above 
Invention concerning claim 3 as the example by necessarily not being restricted to 
equipment with a stereo every predetermined element color " the above-mentioned 
predetermined time " a spectrum, while integrating with the picturized color signal and 
outputting the integral result When the white balance of this color signal is adjusted based 
on this integral result and a correction color signal is outputted, it has considered as the 
configuration which compares the element color percentage of this integral result with the 
element color percentage of this correction color signal of each pixel, and controls the gain 
level of the luminance signal based on this correction color signal. 

[0012] That is, it is effective also not only as the equipment which not necessarily has a 
stereo but its approach. Moreover, as an example of embodiment of the thought of this 
invention, when becoming the software of camera signal processing, naturally it exists on 
the record medium which recorded this software, and is used, invention which relates to 
claim 4 as the example " every predetermined element color the above-mentioned 
predetermined time a spectrum, while integrating with the picturized color signal and 
outputting the integral result When the white balance of this color signal is adjusted based 
on this integral result and a correction color signal is outputted, it has considered as the 
configuration which compares the element color percentage of this integral result with the 
element color percentage of this correction color signal of each pixel, and controls the gain 
level of the luminance signal based on this correction color signal. 

[0013] This record medium may be a magnetic-recording medium, and may be an optical 
recording medium. Moreover, a part is software, when a part is realized by hardware, 
there is nothing that is completely difierent in the thought of this invention, and the thing 
of the gestalt which records the part on the record medium and is read suitably if needed is 
also contained. 
[0014] 

[Embodiment of the Invention] Hereafter, the operation gestalt of this invention is 
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explained based on a drawing. Drawing 1 shows the video camera as a camera signal 
processor concerning 1 operation gestalt of this invention with the block diagram. If a video 
camera 10 is equipped with the RGB code input section 20 which inputs the RGB code 
based on a continuous photographic subject image, and the RGB code processing section 30 
which adjusts a white balance to each and changes each color component of this RGB code 
into YC signal and an RGB code is inputted based on a continuous photographic subject 
image, it will carry out transform processing of each color component of this RGB code to 
each based on the hue concerning the photographic subject image of a front scene. It has 
CCD21 which changes into an electrical signal the photographic subject image to which 
image formation of the RGB code input section 20 was specifically carried out, and outputs 
a color signal, and the RGB matrix 22 which changes this color signal into an RGB code, 
and the inputted photographic subject image is changed into an electrical signal, and the 
acquired color signal is changed into an RGB code. That is, CCD21 consists of image 
sensors connected to the lens which is not illustrated, changes into a corresponding 
electrical signal the photographic subject image by which image formation was carried out 
to each pixel, and outputs a color signal. Moreover, it connects with CCD21, and the color 
signal which consists of Green and the Magenta which were inputted from this CCD21, 
cyanogen, and yellow is changed into the RGB code which consists of an R component (red), 
a G component (green), and a B component (blue), and the RGB matrix 22 outputs it for 
every color component. 

[0015] An integral means 31 to, output the integral result for every color component on the 
other hand while the RGB code processing section 30 integrates with the above-mentioned 
RGB code over predetermined time, The gain controller 32 which adjusts a white balance 
about this RGB code, and outputs an adjustment RGB code. The white balance control 
means 33 which controls the white balance adjustment in the gain controller 32 based on 
each integral result. The YC matrix 34 which changes an alignment ready RGB code into a 
luminance signal and a color-difference signal. The brightness gain controller 35 which 
controls the gain level of this luminance signal if needed, and outputs an adjustment 
luminance signal, It has a brightness control means 36 to compare the RGB percentage of 
this integral result with the RGB percentage of an alignment ready RGB code, and to 
restrict the gain level of this luminance signal according to extent of this deflection when 
the deflection of the color temperature of the image based on an alignment ready RGB code 
and the color temperature of a photographic subject image is large. 

[0016] If the integral means 31 integrates with the above-mentioned RGB code over 
predetermined time and outputs the integral result for every color component by this 
configuration, a correction factor will be computed so that the white balance control means 
33 may suit the white balance of this RGB code based on each integral result. And if the 
RGB code based on the photographic subject image of the following scene is inputted, the 
gain controller 32 will multiply this RGB code by this correction factor, will adjust a white 
balance, will output an adjustment RGB code, and will change into the luminance signal 
and color-difference signal of the YC matrix 34. Moreover, it finds the integral over 
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predetermined time similarly about this RGB code, and the integral result for every color 
component is outputted. At this time, the brightness correction factor which the brightness 
control means 36 compares the RGB percentage of this integral result with the RGB 
percentage of an adjustment RGB code, and restricts the gain level of this luminance 
signal according to extent of this deflection when the deflection of the color temperature of 
the image based on an aUgnment ready RGB code and the color temperature of a 
photographic subject image is large is computed, this luminance signal is multiplied by 
this brightness correction factor, and an adjustment luminance signal is outputted to the 
brightness gain controller 35. 

[0017] Specifically, the integral means 31 will integrate with each color component of an 
RGB code predetermined time every to each, if it connects with the RGB matrix 22, and the 
power source of a video camera 10 is turned on or a photographic subject image is inputted 
into CCD21. It connects with the RGB matrix 22 similarly, and the gain controller 32 also 
multiplies by the correction factor inputted into this RGB code fi:om the white balance 
control means 33, and outputs the adjustment RGB code which the white balance suited to 
the light source to the YC matrix 34 and the brightness control means 36. 
[0018] It connects between the integral means 31 and the gain controller 32, and the white 
balance control means 33 detects the bias of each color component in an RGB code based on 
the integral result for every color component, computes the correction factor for doubling a 
white balance, and outputs it to the gain controller 32. It connects with the gain controller 
32 and the YC matrix 34 changes a luminance signal into a color-difference signal for an 
adjustment RGB code. It connects with the YC matrix 34 and the brightness gain 
controller 35 outputs the amendment luminance signal with which it multiplied by the 
brightness correction factor outputted to this luminance signal fi-om a brightness control 
means if needed, and gain level was restricted. 

[0019] The brightness control means 36 computes the brightness correction factor for 
connecting with the integral means 31 and the gain controller 32, inputting an integral 
result and an adjustment RGB code, comparing the element color percentage of this 
integral result with the element color percentage of an alignment ready RGB code, and 
restricting the gain level of this luminance signal according to extent of this deflection, 
when the deflection of the color temperature of an adjustment RGB code and the color 
temperature of a photographic subject is large, and outputs it to the brightness gain 
controller 35. 

[0020] Here, it explains, referring to drawing 2 about the procedure which carries out 
white balance adjustment of the RGB code obtained when a person image is photoed under 
the hght source which wore redness. If the RGB code based on a person image is outputted 
from the RGB matrix 22, as the integral means 31 integrates with each color component 
and shows it to A of drawing 2 , the integral value of R component will output the integral 
result from which the integral value of B component serves as min the maximum. If this 
integral result is inputted into the white balance control means 33, the correction factor for 
taking adjustment of each color component will be computed. That is, as shown in B of 
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drawing 2 , the correction factor for every color component from which the correction factor 
by which the correction factor by which R component is multiplied multiplies B component 
by min serves as max is computed. And at the maximum, as shown in drawing 2 at C, as it 
is indicated in D of drawing 2 as the above-mentioned RGB code from the RGB matrix 22 
from which the gain level of B component serves as min, the gain level of R component If 
the correction factor computed by the white balance control means 33 is inputted into the 
gain controller 32, the gain controller 32 will multiply by these, a white balance will be 
adjusted, and as shown in E of drawing 2 , the adjustment RGB code by which the gain 
level of each color component was adjusted will be outputted. 

[0021] Moreover, after computing a correction factor in this way, it explains, referring to 
drawing 3 about the case where it changes to the photographic subject F which equips 
right-hand side with a green grid pattern suddenly, while equipping left-hand side with a 
red grid pattern. At this time, as shown in G of drawing 3 , as for the RGB code in a 
left-hand side red part, only R component exists, and GB component is in about 0 condition. 
On the other hand, as shown in H of drawing 3 , as for the RGB code in a right-hand side 
green part, only G component exists, and RB component is in about 0 condition. If it 
multiplies by the above-mentioned correction factor shown in B of drawing 3 to this 
photographic subject and a white balance is adjusted, as I and J of drawing 3 show, each 
adjustment RGB code will be outputted. In order to multiply a full screen by the correction 
factor uniformly, the intensity level to which the direction of a green part corresponds 
relatively to a red part becomes large. 

[0022] Then, this adjustment RGB code is compared with the above-mentioned integral 
result, and the brightness control means 36 controls the brightness gain controller 35, and 
when the deflection of the color temperature of the image based on an alignment ready 
RGB code and the color temperature of the above-mentioned photographic subject is large, 
as shown in K and L of drawing 3 , the gain level of a luminance signal is restricted 
according to extent of this deflection. For this reason, even if it is the case where an input 
image changes suddenly after adjusting a white balance, it can prevent that the feeling of 
resolving of the image which follows and corresponds to this change is spoiled. In this way 
A brightness control means 36 to compute the brightness correction factor for comparing 
the RGB percentage of an integral result with the RGB percentage of a correction RGB 
code, and restricting the gain level of this luminance signal according to extent of this 
deflection when the deflection of the color temperature of the image based on an alignment 
ready RGB code and the color temperature of a photographic subject image is large, The 
brightness gain controller 35 which multiplies the luminance signal outputted from the YC 
matrix 34 by this brightness correction factor, and restricts gain level is this semantics, 
and constitutes the intensity-level control means. 

[0023] Although the video camera 10 concerning this operation gestalt is performing 
camera signal processing with the combination of the above-mentioned hard logic, it does 
not necessarily need to be such a configuration. For example, it is also possible to have 
CPU, to start the camera signal-processing program written in ROM connected to this 
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CPU, and to perform various control. 

[0024] Next, actuation of the video camera concerning this operation gestalt is explained. If 
it changes into the electrical signal with which CCD21 corresponds and a color signal is 
outputted when a photographic subject image is inputted through the lens which is not 
illustrated, the RGB matrix 22 will change this color signal into an RGB code, and will 
output it for every color component. 

[0025] If the integral means 31 integrates with this RGB code for every color component 
and outputs that integral result, the white balance control means 33 will compute and 
output a correction factor based on this integral result. By the gain controller 32 into which 
this correction factor was inputted, it multipUes by the correction factor corresponding to 
the RGB code of each color component, and gain level is adjusted. That is, when the 
photographic subject image under the light source which wore redness is inputted, the gain 
level of R component is decreased, and when the photographic subject image under the 
Hght source which wore blueness is inputted, the gain level of B component is decreased. 
[0026] Here, if a photographic subject image changes to the following scene, the RGB code 
which corresponds like the case where it mentions above will be outputted. The gain 
controller 32 squares the above-mentioned correction factor for each color component of 
this RGB code, and outputs an adjustment RGB code to it. Then, the brightness control 
means 36 compares the RGB percentage of an integral result and the RGB percentage of 
an alignment ready RGB code which integrated with the RGB code at this time. When the 
deflection of the color temperature of the image based on an adjustment RGB code and the 
color temperature of a photographic subject image is large, the brightness correction factor 
for restricting the gain level of the luminance signal outputted from the YC matrix 34 is 
computed. Then, the brightness gain controller 35 outputs the amendment luminance 
signal with which this luminance signal was multiplied by this brightness correction factor, 
and gain level was restricted. 

[0027] Thus, if the following scene is inputted after computing the correction factor which 
doubles a white balance about each color component of the RGB code based on the inputted 
photographic subject image While multiplying a corresponding RGB code by this correction 
factor and generating an adjustment RGB code The RGB percentage of the integral result 
based on the RGB code of this scene is compared with the RGB percentage of an alignment 
ready RGB code, and when the deflection of the color temperature of the image based on an 
alignment ready RGB code and the color temperature of a photographic subject image is 
large, the gain level of this luminance signal is restricted according to extent of this 
deflection. 
[0028] 

[Effect of the Invention] As explained in detail above, according to this invention, the 
camera signal processor in which effective white balance adjustment is possible can be 
offered. Moreover, even when according to invention concerning claim 2 an input image 
changes suddenly after adjusting a white balance, the feeling of resolving of the image 
which follows and corresponds to this change can be maintained. Furthermore, according 
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to invention concerning claim 3, the camera signal-processing approach in which effective 
white balance adjustment is possible can be offered, and the medium which recorded the 
control program of the camera signal processor which performs same processing by 
computer can be offered according to invention concerning claim 4. 

DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing l] It is the block diagram showing the configuration of the video camera 
concerning 1 operation gestalt of this invention. 

[Drawing 2] It is the chart Fig. showing the procedure of the RGB code at the time of white 
balance adjustment. 

[Drawing 3] It is the chart Fig. showing the procedure of an RGB code when a photographic 
subject changes suddenly. 

[Drawing 4] It is the block diagram showing the configuration of the video camera 
concerning the conventional example. 
[Description of Notations] 

10 - Video camera 20 - RGB code input section 21 " CCD 22 - RGB matrix 30 RGB code 
processing section 31 - Integral means 32 " Gain controller 33 - White balance control 
means 34 - YC matrix 35 - Brightness gain controller 36 - Brightness control means. 
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